MetAdapt: Meta-learned task-adaptive architecture for few-shot classification

نویسندگان

چکیده

• We propose a feed-forward model rewiring its architecture according to few-shot task. meta-learned NAS-cell controllers for predictive rewiring. show performance preserving way of pruning feed-forward-adaptive NAS-cells. Using the proposed approach, we obtain strong results on two popular FSC benchmarks. Recently, great progress has been made in field Few-Shot Learning (FSL). While many different methods have proposed, one key factors leading higher FSL is surprisingly simple. It backbone network used embed images tasks. first works resorted small architectures with just few convolution layers, recent that large pre-trained training portion datasets produce features are more easily transferable novel tasks, thus attaining significant gains using them. Despite these observations, little no work done towards finding right FSL. In this paper MetAdapt not only meta-searches an optimized Network Architecture Search (NAS), but also can adaptively ‘re-wire’ itself predicting better given approach observe benchmarks: mini ImageNet and FC100.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Meta-Learning for Semi-Supervised Few-Shot Classification

In few-shot classification, we are interested in learning algorithms that train a classifier from only a handful of labeled examples. Recent progress in few-shot classification has featured meta-learning, in which a parameterized model for a learning algorithm is defined and trained on episodes representing different classification problems, each with a small labeled training set and its corres...

متن کامل

Few-Shot Learning with Meta Metric Learners

Existing few-shot learning approaches are based on either meta-learning or metriclearning, which would suffer if the tasks have varying numbers of classes and/or the tasks diverge significantly. We propose meta metric learning to deal with the limitations of the existing few-shot learning approaches. Our meta metric learning approach consists of two components, task-specific learners that explo...

متن کامل

Few-shot Classification by Learning Disentangled Representations

Machine learning has improved state-of-the art performance in numerous domains, by using large amounts of data. In reality, labelled data is often not available for the task of interest. A fundamental problem of artificial intelligence is finding a representation that can generalize to never seen before classes. In this research, the power of generative models is combined with disentangled repr...

متن کامل

Meta-SGD: Learning to Learn Quickly for Few Shot Learning

Few-shot learning is challenging for learning algorithms that learn each task in isolation and from scratch. In contrast, meta-learning learns from many related tasks a meta-learner that can learn a new task more accurately and faster with fewer examples, where the choice of meta-learners is crucial. In this paper, we develop Meta-SGD, an SGD-like, easily trainable meta-learner that can initial...

متن کامل

Few-shot Object Detection

In this paper, we study object detection using a large pool of unlabeled images and only a few labeled images per category, named “few-shot object detection”. The key challenge consists in generating trustworthy training samples as many as possible from the pool. Using few training examples as seeds, our method iterates between model training and high-confidence sample selection. In training, e...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Pattern Recognition Letters

سال: 2021

ISSN: ['1872-7344', '0167-8655']

DOI: https://doi.org/10.1016/j.patrec.2021.05.010